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(54) Natural language search method and apparatus 

(57) A method and apparatus for performing a 
search for information containing natural language is 
disclosed which uses a natural language query. The 
query is input in the form of units of the natural language 
and this is matched with units in the natural language of 
the data. Where there are unmatched units in the query 
and/or the data, context data in the form of one or more 
unmatched units of the query and/or the data is gener- 
ated. Each unmatched unit as a predefined linguistic re- 
lationship to one of the or each matched unit. Output 
data is formed as matched units with any respective 
context data. 
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Description 

[0001] The present invention generally relates to a method and apparatus for performing a search for information 
containing natural language using a natural language query. The present invention particularly relates to such a method 

5 and apparatus for providing context information for the best matches to the natural language query. 

[0002] Most information retrieval systems are quite good at finding information but poor in presenting the results to 
users. Typically the results are presented as a simple list of documents or document headers, sometimes with a rele- 
vance score. A few web search engines attempt to improve on this by, for example, grouping pages from the same 
site together. It is difficult for users to make effective use of results lists, because the results list does not show how 

10 documents are related to one another and to the original query. 

[0003] Information retrieval systems can retrieve information using linguistic queries in several ways. The simplest 
and most common is the use of key words. Key words can be combined using Boolean logic or statistical techniques 
to form a query. It is also known from an article by S Flank entitled "A Layered Approach to NLP-Based Information 
Retrieval" (Proceedings of the 36 Annual Meeting of the Association of Computational Linguistics, page 397, 1998) 

15 that a natural language input can be translated to a search engine specific Boolean logic query. Such a technique, 
however does not benefit from the syntactic information which is available in a natural language query. Such information 
can only be utilised by exploiting the structure of the query and the information by some form of parsing. 
[0004] The retrieval of information using syntactic information from natural language queries has been achieved in 
many prior art systems. A system described in J Fagans PhD Thesis entitled "Experiments in Automatic Phrase Indexing 

20 for Document Retrieval : A Comparison of Syntactic and Non-Syntactic Methods" (PhD Thesis Cornell University, Tech- 
nical Report TR 87-868) uses augmented phrase structure rules to selectively extract phrases from parse trees gen- 
erated by an automatic syntactic analyser. 

[0005] Natural language processing based information retrieval is also described in the paper by Flank referenced 
above. The technique described in this paper uses noun phrase syntax analysis. 

25 [0006] Another method of retrieving information is disclosed in an article by C Schwartz entitled "Automatic Syntactic 
Analysis of Free Text" (General American Society For Information Science, September 1990, pages 408 to 417). In 
the technique disclosed by Schwartz, noun phrases are identified in the natural language passages in the query and 
in the information and they are selected for parsing. The parsed noun phrases are normalised so that the meaning 
representation structure is fitted to standard or common dependency structures. Noun phrase matching then takes 

30 place by a straightforward comparison of the normalised meaning representation structures in order to identify identical 
paths and nodes. 

[0007] Whilst the use of syntactic information from natural language queries in the retrieval of information can provide 
a more accurate searching technique, it does nothing to overcome the problem of how to present the results of the 
search. The results of the search are merely the best match or matches to the query with no information on how the 
35 documents are related to one another or to the original query. 

[0008] It is an object of the present invention to address this problem by using syntactic information to give the results 
of the search in context. 

[0009] In accordance with an aspect of the present invention there is provided a search engine for searching for data 
in the form of units of a natural language. An input query is matched to a plurality of available sets of information to 

40 identify the best matches and to identify which words in the query and in the sets of information match. For a number 
of the best matches the unmatched units in the query and/or the sets of information are used to form context data. The 
context data comprises one or more unmatched units of the query and/or the sets of information each of which has a 
predefined syntactic relationship to one of the matched units. The data output thus comprises the matched units and 
the unmatched units which have a linguistic relationship to the matched units. This additional context information en- 

45 ables the user of the search engine to not merely identify what is matched but also the context in which it matched. 
This provides far richer information enabling a user to understand the results of the search far more easily. 
[001 0] In the context of the present invention natural language data comprises a series of units of a natural language 
which have linguistic relationships therebetween. 

[001 1] The matching technique can comprise a simple keyword matching technique. This has the benefit of simplicity 
50 but does not benefit from the syntactic information available to improve the matching process. If keyword searching is 
used, the syntactic information used for forming the context data can be determined by a parsing operation either 
before or after the matching process. 

[001 2] In order to make use of the syntactic information available in the input query and in the sets of information, 
preferably, the query and the sets of information are parsed and the matching takes into account the syntactic structure 
55 of the query and the sets of information in order to determine the match. 

[001 3] The level of syntactic information used in the matching can be simple related pairs of words such as used in 
the work by Flank and Fagan as referenced hereinabove, or even a full set of semantic relationships between the 
words as described in the applicants co-pending European Application Number: 99307422.8 filed on 20 September 
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1999. 

[001 4] In order to obtain the syntactic information, the parser used can be of any form. For example, the dependency 
parsers disclosed in GB-A-2269923, EP-A-0737928, a paper by T. Jarvinen and P Tapanainen entitled "A Dependency 
Parser for English" (Technical Report No. TR-1 ,. Department of General Linguistics, University of Helsinki, March 1 997), 

5 and a paper by P Tapanainen and T Jarvinen entitled "A Non-Projective Dependency Parser" (Proceedings of the 5th 
Conference on Applied Natural Language Processing, Washington DC, April 1 997, Association for. Computational Lin- 
guistics). A dependency parser, parses the natural language to generate meaning data which comprises meaning 
representations for the words and links between them. The links indicate which meaning representation modifies the 
meaning of other, meaning representations and the links and type of. links are determined with regard to the grammar 

10 of the natural language. 

[001 5] An embodiment of the present invention uses the output of a finite state parser implementing a dependency 
parser technique as described in co-pending application entitled: "Apparatus and Method for Generating Processor 
Usuable Data from Natural Language Input Data" filed herewith claiming priority from UK Patent Application No. 
9904663.3 filed 1 March 1999 by the present applicants. 

15 [001 6] The searching technique is applicable to the retrieval of information of many different types. For example r the 
natural language query can be used to retrieve document data. In this case, either the natural language query can be 
compared directly with the contents of the document, or it can be compared with an abstract of the document in order 
to perform the matching operation. The searching technique is also applicable to retrieval of non-text data. Such data 
requires a natural language caption in the form of meta data. For example, in order, to retrieve images from an image 

20 database, where images are given captions which describe the content of the images, a natural language query can 
be used in order, to search the database to obtain a best match or matches to data in the database. 
[001 7] The context data of the present invention comprises one or more unmatched units each of which has a pre- 
defined linguistic relationship to one of the matched units. In one embodiment this relationship comprises the modifi- 
cation relationship between the units. This information is obtained from a dependency parser. The generation of the 

25 context data in this embodiment is achieved in accordance with one or more rules which define contextually important 
modification relationships between matched and unmatched units. Thus the rules define the sort of context information 
which is to be output. 

[0018] More generally, in an embodiment the context data of the present invention is generated using one or more 
rules which contain syntactic and semantic constraints for the formation of the context data. 

30 [001 9] I n an embodiment of the present invention , the generated context data is not just output, but is used to structure 
the results of the search. The search result is thus the sets of information, which comprise the best matches to the 
input query, ordered in accordance with the context data. This ordering can take the form of a hierarchical arrangement 
of indexes wherein the indexes are layered in accordance with the syntactic relationships. The indexes comprise the 
matched and unmatched words of the context data. This embodiment enables a user to more easily grasp the signif- 

35 icance and relationships between the matches obtained from the search. 

[0020] The present invention also provides an enhanced data retrieval system since the desired data obtained as 
best matches to the input query is output together with this associated context information to enable a user to identify 
why the search has found that particular, piece of data. 

[0021] The present invention can be implemented by software operating on a multi-purpose computer. The present 
40 invention is thus embodied by a computer program provided on a storage media such as a floppy disk, optical disk, 
magnetic tape, or programmable memory device. Further, since the computer program can be transmitted over, a 
network such as the internet, the present invention can be embodied as a signal carrying the computer code. 
[0022] Embodiments of the present invention will now. be described with reference to the accompanying drawings, 
in which: 

45 

Figure 1 is a functional diagram of an embodiment of the present invention; 
Figure 2 is a schematic diagram of an embodiment of the present invention; 
Figure 3 is a flow diagram illustrating the operation of an embodiment of the present invention; 
Figure 4 illustrates the syntactic information used in the generation of the context data; 
50 Figure 5 is a flow diagram illustrating the use of the context data for the ordering of the results of a search in 

accordance with an embodiment of the present invention; and 
Figure 6 is a functional diagram of another embodiment of the present invention. 

[0023] A first embodiment of the present invention will now be described with reference to Figures 1. to 5. 
55 [0024] Figure 1 is a diagram illustrating the functional units of an embodiment of the present invention. An interface 
1. is provided for a user to input data and to receive output data including context data. This interface includes a device 
la for allowing the user to enter a query. The interface 1 also includes an output device 1b for outputting the search 
data and the context data enabling a user to more readily understand the relationship between the query and the 
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retrieved data and the relationships between the retrieved data. 

[0025] A parser 2 is provided for receiving the input query from the query input device la to generate semantic and 
syntactic information. The parser 2 also parses information from a database 3 which is to be searched. The parser 2 
thus generates two sets of parsed data which is passed to a matching engine 4 to match the parsed data. The matching 

5 engine 4 in this embodiment performs matching using both semantic and syntactic information from the parser 2. The 
use of the semantic and syntactic information provides a more accurate matching technique. 
[0026] A context generating engine 5 receives data from the matching engine 4 and also receives linguistic relation- 
ship data from a storage device 6. A context generating engine 5 generates context data for the matched data in 
accordance with the linguistic relationship data. A context gathering engine 7 receives the context data and uses this 

10 to generate a hierarchical index structure. This structure is used to organise the data retrieved from the database 3 so 
that it is ordered in accordance with the context data. The best match data, ordered in accordance with the context 
data, is then passed to the data output device 1b for presentation to the user 

[0027] Figure 2 illustrates schematically an embodiment of the present invention comprising a multi-purpose com- 
puter programmed to implement the present invention. The various components of the computer are illustrated linked 

15 by the computer bus 14. A display device 10 is provided for outputting the search results and the context data. A 
processor 11 is provided and this implements software to perform the function of the matching engine lla, the context 
data generating and gathering engine lib and the parser 11c illustrates as functions in Figure 1 .. A read-only memory 
device (ROM) 12 is provided and comprises the Bios of the computer A working memory comprising random access 
memory (RAM) 1 3, is provided for use by the processor during the implementation of the programs. A keyboard 1 7 is 

20 provided to allow the input of the query by the user. A storage device 1 5 such as a hard disk drive is provided for storing 
computer programs and data. The computer programs comprise the operating system for the computer, the parser 
program code for causing the processor 11 to implement the parser lie, the matching program code for causing the 
processor 1 1 to implement the matching engine lla, and the context generating and gathering program code for causing 
the processor to implement the context data generating and gathering engine lib. The data stored in the storage device 

25 15 comprises the parser data required by the parser program for the implementation of the parser lie, matching data 
for use by the matching program to implement the matching engine lla, and linguistic relationship data for use by the 
context data generating and gathering program to implement the context data generating and gathering engine lib. 
[0028] The database 1 6 is also provided and comprises the database 3 of Figure 1 . This database contains the sets 
of data to be found by the search. 

30 [0029] A communication interface 18 is provided for interfacing the computer to a network such as a local area 
network or the internet. Thus although in this embodiment the database 1 6 is shown as being within the compute^ the 
database can be remote and accessible over the network. 

[0030] The general operation of this embodiment of the present invention will now be described with reference to 
Figure 3. 

35 [0031 ] In step S1 the user inputs a natural language query. This input query is then parsed in step S2. In step S3 a 
set of reference data in the database to be searched is selected and parsed. The parser in this embodiment comprises 
a finite state parser carrying out a dependency parsing operation. Finite state parsers in general are well known and 
the specifics of the implementation are not important for a description of the invention. The specific implementation is 
disclosed in the co-pending application entitled: "Apparatus and Method for Generating Processor Usuable Data from 

40 Natural Language Input Data". 

[0032] The parsed query and set of reference data then undergo matching in step S4 to identify the matched linguistic 
units. A linguistic unit can comprise any lexical unit such as a word or multi-words such as "the white house". The 
matching process carried out is in accordance with the process described in the applicants earlier European Application 
Number: 99307422.8. 

45 [0033] In step S6 it is determined whether there are any words which match as a result of the matching step. If not, 
in step S7 because there are no matched words between the query in the set of reference data it is then determined 
if there are more sets of reference data to be matched. If so the process returns to step S3, otherwise the process 
terminates in step S8 with the output of any context data stored in the memory. 

[0034] The data generated as a result of the matching operation and using the finite state parser is data indicating 
50 a sequence of words, their parts of speech, a phrase bracketing structure, and the dependency relationships. 

[0035] In step S9 a first matched word t in the set of matched words T is selected. It is then determined in step S10 
whether there are any unmatched words in the set of reference data. If not, the process proceeds to step S7 because 
there is no context information which can be generated for the set of reference data. Thus, the input query matched 
the set of reference data. If however, there are unmatched words indicating that the set of reference data contains 
55 additional information not requested in the query, in step S11 the first unmatched word u in the set of unmatched words 
U is selected. It is then determined whether the unmatched word u is at the end of a modification path from the matched 
word t. The paths are defined in path rules. The path rules define the lexical part of speech for the matched word, a 
valid path description from the matched word to the unmatched word and the phrasal category or lexical part of speech 
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for the unmatched word. If it is determined that the matched word t and the unmatched word u are not linked in ac- 
cordance with the path rules, it is determined in step S1 7 whether there are any unmatched words left unprocessed. 
If there are i n step S 1 3 the next unmatched word u is selected and the process returns to step S 1 2 . If not, i n step S 1 8 
it is determined whether there are any matched words which are unprocessed. If not, the process returns to step S7 

5 since the algorithm has processed all matched and unmatched words for the set of reference data. If there are still 
matched words to process in step S19 the next matched word t is selected and the process returns to step S1 0. 
[0036] If in step SI 2 it is determined that the unmatched word u is at the end of a path from a matched word t as 
defined in the path rules, in step S 1 4 it is determined whether the unmatched word u is present in a valid phrase defined 
in the valid phrase rule. If there is no valid phrase, in step S1 3 the next unmatched word u is selected and the process 

10 returns to step S 1 2 . If a valid phrase is identified the smallest valid phrase containing the word u is determined in step 
S15 and in step S16 the phrase is added to the memory referenced to the matched word t. The memory thus stores 
the context data as unmatched words or phrases reference or linked to the respective matched words. 
[0037] The valid phrase can comprise a part of speech for a word, or a phrasal category for a group of words. In 
step S17 it is then determined whether there are any unmatched words still left unprocessed and if so the process 

15 returns to step S 1 3 to select the next unmatched word. If not in step S 1 8 it is determined whether there are any matched 
words left unprocessed. If not the process returns to in step S7 since the unmatched and matched words have been 
processed for the set of reference data. If there are still matched words to be processed, in step S 1 9 the next matched 
words t is selected and the process returns to step S 1 0. 

[0038] Once a query has been input and parsed, the parsing, matching and context generation steps will be repeated 

20 for each set of reference data . 

[0039] The operation of steps S9 to S 1 9 will now be described in more detail with reference to an example. 
[0040] The output of the matching process using the finite state parsing technique is a phrase represented as a 
sequence of words with their parts of speech, a phrase bracketing structure^ and the dependency relationships. Here- 
inafter the part of speech (pos) is given by following each word with "_POS". The phrase bracketing for a phrase type 

25 PT is given as "[...JPT. In addition words in the sets of reference data which match words in the query are marked in 
BOLD. 

[0041] For the query: 

"camera with a lens" 
and the reference data: 
30 "black SLR camera with a zoom lens on a white surface" 
the data output from the matching engine is: 

[[black_adj SLR_noun camera_noun]NG, 
[with_prep a_det zoom_noun lens_noun]PP, 
[on_prep a_det white_adj surface_noun]PP]NP 

35 

mod[camera]=black 
mod[cameraJ=SLR 
pmod[camera]=with 
pmod[camera]=on 
40 mod[with]=lens 
mod[lens]=zoom 
mod[on]=surface 
mod[surface]=white 

45 [0042] In the notation given hereinabove, the parts of speech are: 

adj - adjective 

noun - noun 

prep - preposition 

50 det - determiner 

[0043] The phrase types are: 

NG - noun group 
55 pp - prepositional phrase 
NP. - noun phrase 

[0044] The dependency relationships are given as indexed variables as generated by the finite state parser described 
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in co-pending application entitled: "Apparatus and Method for Generating Processor Usuable Data from Natural Lan- 
guage Input Data" filed herewith. Thus mod[camera]=black defines that the modifier of the word "camera" is the word 
"black". A prepositional modifier (pmod) of the word "camera" is the word "on". 

[0045] Figure 4. illustrates the modification relationships i.e. paths for the query and the reference data set. 
5 [0046] Hereinafter a path is referred to and comprises a modification relationship between two words. For example, 
a path from the word "camera" to the word "black" is given by a simple modification relationship i.e. mod. The path 
from the "camera" to the word "surface" is given by two consecutive paths pmod and mod via the word "on". 
[0047] The algorithm uses path rules as mentioned hereinabove. Each path rule has the form <r t ,r p ,r c >, where 

1 o r t is a lexical part of speech for the matched word, 

r p is a path description as described hereinabove, and 

r c is a phrasal category or a lexical part of speech for the unmatched word. 

[0048] Any one of these can be defined by a wildcard \ This means that the rule allows any value to be used e.g. 
15 any lexical part of speech, any path, or any phrasal category. 

[0049] The path descriptions take the form of a list of variable names e.g. mod or pmod:mod. 
[0050] In the algorithm three tests are performed each test results in a Boolean result. 

has_pos(t,c) 

20 

[0051] t is a matched word and c is a part of speech. has_pos(t,c) is true if either t has the part of speech c or if c is 
a wildcard *. 

on_path(t,u,p) 

25 

[0052] t is a matched word, u is an unmatched word, and p is a path description. 

[0053] on_path(t,u,p) is true if either p is a * or there is an unmatched path of type p from t to u i.e. the relationships 
in the path p are followed to get from t to u. This can be expressed recursively as follows. If p consists of a single 
element, then on_path(t,u,p) is true if and only if u is a member of p[t]. If p is a list of variable names, of which the first 
30 is q and the rest of the list is r, then on_path(t,u,q:r) is true if and only if there is some word w which is a member of q 
[t] such that w is not marked as matched and on_path(w,u,r) is true. The reason for saying "is a member of here is 
that an indexed variable can have several words stored in it, as in example of pmod[camera]={with,on} illustrated above. 

Valid- Phrase (C,p,u) 

35 

[0054] p is a lexical part of speech or a phrasal category, u is an unmatched word. C is a phrase or word, valid phrase 
(C.p.u) is true if C has a category or part of speech p and u occurs in C. 

The Main Algorithm 

40 

[0055] The main algorithm implemented by steps S7 to S1 7 can be written in pseudo code as follows: 

[0056] Let S be the set of contexts, initially empty (output). 

[0057] Let P be the set of path rules (input) . 

[0058] Let T be the set of current words, initialised to all matched words (input). 

45 [0059] Let U be the set of available words, initialised to all unmatched words (input). 
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while T is not empty 
< 

select a word t from T 
for each word u in U 
( 



if there is a path rule <r t ,r p ,r c > in P such 

that 

has_pos(t, r t ) 
AND on_path(t,u,r p ) 
then 

find the smallest phrase C such that 
valid_phrase (C,r c ,u) 

if there is such a C then 
add the context <t,C> to S 
remove u from U 

} 

remove t from T 

} 

[0060] By "smallest phrase" what is meant is that if there is a valid phrase C and valid phrase D, and C is entirely 
contained within D, then the C is used. 

[0061] The operation of the algorithm will now be illustrated with reference to the example described hereinabove 

and illustrated in Figure 4. 

[0062] The initial set T={camera,lens} 

[0063] The initial set U^black.SLR.zoom.white.surface, with,on,a}. 
[0064] The path rules to be used are: 

1. <*,mod *> (this finds modifiers) 

2. <*,pmod:mod,PP> (this finds prepositional phrases (PPs)) 

[0065] With the first matched word t="camera", and in the first unmatched word u="black" the first rule applies be- 
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cause: 

has_pos(camera,*)=TRUE 
on_path(camera,black,mod)=TRUE 

5 

[0066] We can find a suitable phrase (actually a single word) C=[black]adj so the context data <carnera,[black]adj> 
is added to the set S. 

[0067] With the second unmatched word u="SLR" rule 1 applies for the same reason as given above and thus the 
context data <camera,[SLR]noun> is added to the context data set S. 
10 [0068] The only other word in the set U which complies with the path rules is the word "surface". When u="surface" 
rule 2 applies because: 

has_pos(camera,*)=TRUE 
on_path(camera,surface,pmod:mod)=TRUE 

15 

[0069] A suitable phrase C=[on a white surface] PP can be found, and so the context data <camera,[on a white 
surface]PP> is added to the context data set S. 

[0070] All of the unmatched words for the matched word t- 'camera" have thus been processed. 
[0071] The next matched word t="lens" is then selected. The only word for which the path rules apply is the word 
20 u="zoom". Rule 1 applies because: 

has_pos(lens *)=TRUE 
on_path(lens,zoom,mod)=TRUE 

25 [0072] A suitable phrase (actually a single word) is C=[zoom]noun, so the context data <lens,[zoom]noun> is added 
to the context data set S. 

[0073] The result of the algorithm is thus a set S of context data. Each entry in the set comprises a matched word 
and an unmatched word or phrase linguistically related to the matched word. This data can be output to a user to 
enable them to identify where the input query matches the set of data and the context of each of the matched words. 
30 [0074] When searching for data, it is most useful to use a query which results in a number of best matches being 
returned. It is thus desirable to use the context information to order the best matches in order to enable a user to see 
how the sets of reference data are related to one another and to the query. The context data generated as described 
hereinabove can be used to achieve this by gathering the contexts. 

[0075] The method of gathering the context data together to structure the search result will now be described. 
35 [0076] For each set of reference data the context data comprises a set of context in the form of a governor word and 
a context phrase. In the example given above the context data comprises: 

<camera,[black]adj> 
<camera,[SLR]noun> 
40 <camera,[on a white surface]PP> 

<lens,[zoom]noun> 

[0077] As can be seen above, there can be more than one context phrase for a governor word. I n the above example, 
"cam era" has three context phrases. 

45 [0078] In order to provide structure to the output context data, additional information is used to context data. It is 
necessary to have knowledge of the head word in the query i.e. the word which does not modify any other word. Also, 
it is necessary to know the modification relationships between the matched (governor) words. For example, it can be 
seen in Figure 4 that the word "camera" is the head of the input query since it does not modify any other word. The 
matched word "lens" is the next matched word (in this example it is in fact the only, other matched word) in the modi- 

50 fication chain from the head word. 

[0079] In addition to this information, a list of path levels is used in order to define the structuring of the output and 
to define the contexts which are of interest. The paths include an empty path which defines a matched (governor) word. 
Other paths such as mod and pmod define the modification path from the matched word to an unmatched word. The 
path can comprise a linked path such as pmod:mod. 

55 [0080] A method of forming the structure output will now be described with reference to Figure 5 and an example of 
data sets. 

[0081] In step S20 of Figure 5 the context data for a plurality of data sets is input. For the query: 
"camera with a lens" 
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[0082] The data sets which match are listed below together with their context data. In the context data Q means that 
there is no context data. Paths between the matched and unmatched words are also given in the context data below 
and are given in [...]. 



camera with a lens 
<> 



10 



Large camera with a lens 
15 <camera [mod], large> 



20 



30 



35 



camera with a lens on a table 

<camera [pmod:mod] , [on a table ]PP> 



25 Large camera with a zoom lens 

<camera [mod], large> 
<lens [mod],zoom> 
camera on a table with a long zoom lens 



<camera [pmod:mod], [on a table ]PP> 
<lens [mod],zoom> 
<lens [mod],long> 



[0083] In step S21 of Figure 5 for each matched (governor) word the context data is concatenated so that there is 
45 a single context data for a particular, matched word and a particular path. In the example given above, the concatenation 
of the last example results in: 

camera on a table with a long zoom lens 
<camera [pmod:mod],[on a table] PP> 
<lens [mod], long & zoom> 
so [0084] In the process of this example the following path list is used: 
[] 

[mod], [pmod:mod] 

[0085] Q indicates an empty path and is used to identify a matched (governor) word. This path is at the first level. 
The paths [mod] and [pmod:mod] are both at the second level. 
55 [0086] Using the path list and knowledge of the head of the input query, the head word is selected in step S22 of 
Figure 5. In step S23 is then determined whether, there are any. context words. If there are not, in step S24 the process 
then determines whether there are any further matched words which have not been processed. If not, in step S30 the 
process terminates by storing any indexes and sub-indexes which have been determined. If there are further matched 
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words to be processed, in step S25 the next matched word in the modification sequence is selected as a sub-index 
and the process returns to step S23. 

[0087] In the present example, in step S23 it is determined that there are context words. Thus in step S26 the context 
data for the second path level is selected i.e. any unmatched words linguistically related to the matched word camera 
5 by the paths mod and pmod:mod. In step S27 the data sets are grouped according to common context words (or the 
lack of context words) and they are indexed by the common context word. The results of sorting the data search using 
the context data for the example given above is illustrated below: 

10 Camera 

large 

large camera with a lens 

15 

large camera with a zoom lens 
[on a table ]PP 
20 camera with a lens on a table 

camera with a long zoom lens on a table 

() 

25 

camera with a lens 

[0088] In the above, the matched word (the head word) is shown in bold. () means empty context: "camera with a 

30 lens" exactly matched the query and there is no context data in relation to camera. 

[0089] In step S28 of Figure 5 it is then determined whether there are any more path levels. If there are more path 
levels in step S29 the next path level is selected and step S27 is repeated to generate further sub-indexed groups of 
data sets. In the present example in step S28 it is determined that there are no more path levels and thus in step S25 
the next matched word is selected as a sub-index. The next matched word in this example is the word "lens" and this 

35 js used as a sub-index for groups of more than one data sets. The process then returns to step S23 where in the 
present example it is determined whether there are context words to be processed and in step S26 the context for. the 
second path level is selected. In step S27 the data sets are grouped according to the common context words and 
indexed accordingly. The result of this is illustrated below: 

40 

Camera 

large 

45 lens 

zoom 

large camera with a zoom lens 

50 

() 

large camera with a lens 

55 
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[on a table J PP 
lens 

5 

long & zoom 

camera with a long zoom lens on 
10 a table 

() 

camera with a lens on a table 

15 

() 

camera with a lens 

20 

[0090] The result in step S30 is the storage of the hierarchial indexes and sub-indexes to which data sets belong. 
For example, the data set "large camera with a zoom lens" is indexed by camera:large:lens:zoom. A camera with a 
lens on a table is indexed by camera:[on a table]PP: lens:(). 

[0091] This ordering of the data using the context data enables the data to be output to a user in a format which 

25 enables the user to more easily understand the context of the match. 

[0092] A number of levels of context information depend upon the path levels used and the number of matched 
words. The number of contexts in each level will depend upon the context of the database being searched. For example, 
in the first level in the example given above there are, only two contexts: large and [on a tablepP. If there were further 
data sets e.g. red camera with a lens on a table,, small camera with a lens on a table etc, the number of contexts in 

30 the first level would be greater. 

[0093] A second embodiment to the present invention will now be described with reference to Figure 6. 
[0094] Figure 6 is a functional diagram of a second embodiment which has similar components to the functional 
diagram of the first embodiment illustrated in Figure 1 .. The second embodiment differs from the first embodiment only 
in that the parser 2 of the first embodiment which receives the input query and the data sets from the database 3, is 

35 replaced with a parser 20 which parses the output of the matching engine 4. In this embodiment the matching engine 
will perform key word matching. The syntactic information required in order to generate the context data is obtained 
by the parsing operation of the parser 20 subsequent to the matching process. This embodiment benefits from a simpler 
matching process but suffers from lack of accuracy in the matching process because of the lack of syntactic information. 
[0095] Although the present invention there has been described hereinabove with reference to specific embodiments, 

40 the present invention is not limited to these specific embodiments and modifications are possible within the scope of 
the invention as defined in the appendant claims. 

[0096] In particular, the present invention is not limited to any particular type of matching process. The matching 

process needs only to identify, words in the query which match words in the sets of data in the database. 

[0097] I n order to obtain the necessary syntactic information to enable the formation of context data, a level of parsing 

45 is required. Any form of parser which can provide some form of the syntactic information can be used in the implemen- 
tation of the present invention. For example, the pure dependency parser can be used as disclosed in the paper entitled 
"Parsing English with a Link Grammar" by D Sleator and D Temperiey (Carnegie Mellon University School of Computer 
Science, Technical Report No. CMEU CS 91 1 96, October 1 991 ). In this system there is no phrase bracketing provided 
but parts of the algorithm that extract phrases could instead extract a sequence of words defined by having certain 

so dependency links with matched terms. Parsers are disclosed in GB-A-226992 3, EP-A-0737928, the paper by T Jarvinen 
and P Tapanainen, and the paper by P Tapanainen and T Jarvinen for example. Also, simpler parsing techniques could 
be used such as disclosed in the paper by S Flank. 

[0098] The present invention is applicable to any form of searching technique and can be used with a wide range of 
search engines such as a web search engine and a database search engine. The output of such a search engine 
55 incorporating the present invention provides far more information to the user and allows the user to see the context of 
the results of the search. 

[0099] Although the present invention has been described hereinabove as residing in a programmed multipurpose 
computer, the present invention can of course be implemented using specifically designed hardware such as a logic 
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circuit. 



Claims 

5 

1 . Search apparatus for searching for data in the form of units of a natural language, the apparatus comprising: 

interface means for receiving an input query in the form of units of the natural language and for outputting the 
results of the search in the form of output data; 
10 matching means for searching for and identifying any matches between the units of the input query and the 

units of the data; 

generating means for, where there are unmatched units in the query and/or the data, generating context data 
in the form of one or more unmatched units of the query and/or the data, each unmatched unit having a 
predefined linguistic relationship to one of the or each matched unit; and 
15 forming means for forming said output data as any said matched units and any respective said context data. 

2. Search apparatus according to claim 1 , wherein said generating means is adapted to generate the or each un- 
matched unit of the context data having a predefined modification relationship to the respective matched units. 

20 3. Search apparatus according to claim 1 or claim 2, wherein said generating means operates in accordance with 
one or more rules defining contextual!/ important modification relationships between matched and unmatched 
units. 

4. Search apparatus according to claim 1 or. claim 2, wherein said generating means operates in accordance with 
25 one or more rules containing syntactic and semantic constraints for the formation of the context data. 

5. Search apparatus according to any preceding claim including parsing means for parsing the input query and/or 
the data or the output of the matching means to determine linguistic relationships between the units. 

30 6. Search apparatus according to any preceding claim wherein said forming means is adapted to form said output 
data as any said matched units associated with respective said unmatched units having said predefined linguistic 
relationship to respective matched units. 

7. Search apparatus according to any preceding claim wherein said forming means is adapted to form said output 
35 data as a layered hierarchical structure identifying sets of data by their context data. 

8. Search apparatus according to claim 7, wherein said forming means is adapted to form said output data as a 
hierarchical structure formed from a said matched word comprising a head word of the input query, said context 
data for said head word forming one or more sublayers, any further matched words forming further sublayers of 

40 said sublayers, the order of selection of said further matched words being dependent on their modification rela- 

tionship within the input query, said context data for said further matched words forming yet further sublayers, said 
sets of data being identified by a final said sublayer in the hierarchical structure. 

9. A computer implemented data processing method for processing data to enhance the results of a search for data 
45 in the form of units of a natural language, the method comprising: 

receiving an input query in the form of units of the natural language and outputting the results of the searching 
the form of output data; 

searching for and identifying any matches between the units of the input query and units of the data; 
so for any matched units in the query and/or the data, generating context data in the form of one or more un- 

matched units of the query and/or the data, each unmatched unit having a predefined linguistic relationship 
to one of the or each matched unit; and 

forming said output data as any said matched units and any respective said context data. 

55 10. A method according to claim 9, wherein the or each unmatched unit of the context data is generated having a 
predefined modification relationship to the respective matched units. 

11 . A method according to claim 9 or claim 1 0, wherein the context data is generated in accordance with one or more 
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rules defining contextually. important modification relationships between matched and unmatched units. 

12. A method according to claim 9 or claim 1 0 r wherein the context data is generated in accordance with one or more 
rules containing syntactic and semantic constraints for the formation of the context data. 

5 

13. A method according to any one of claims 9 to 1 2, including parsing the input query and/or the data or the output 
of the matching step to determine linguistic relationships between the units. 

14. A method according to any one of claims 9 to 13, wherein the output data is formed as any said matched units 
10 associated with respective said unmatched units having said predefined linguistic relationships to respective 

matched units. 

15. A method according to any one of claims 9 to 14, wherein said output data is formed as a layered hierarchical 
structure identifying sets of data by. their context data. 

15 

1 6. A method according to claim 1 5, wherein said output data is formed from a said matched word comprising a head 
word of the input query, said context data for. said head word forming one or more sublayers, any further matched 
words forming further sublayers of said sublayers, the order of selection of said further matched words being 
dependent on their modification relationship within the input query, said context data for said further matched words 

20 forming yet further sublayers, said sets of data being identified by a final said sublayer in the hierarchical structure. 

17. Data retrieval apparatus for retrieving desired information units of a natural language from a plurality of available 
information units, the apparatus comprising: 

25 input means for inputting a query in units of the natural language; 

matching means for searching for and identifying any matches between the units of the input query and the 
units of the available information units to identify the best matches between the input query and the plurality 
of available information units; 

generating means for receiving the best matches and for where there are unmatched units in the input query 
30 and/or the information units, generating context data in the form of one or more unmatched units each having 

a predefined linguistic relationship to one of the or each matched unit; and 

output means for outputting desired information units as the best matches with respective context data. 

18. Data retrieval apparatus according to claim 1 7, wherein said output means is adapted to output the desired infor- 
35 mation units ordered by said context data. 

19. A computer implemented data retrieval method for retrieving desired information units containing units of a natural 
language for a plurality of available information units, the method comprising: 

40 inputting a query in units of the natural language; 

searching for and identifying any. matches between the units of the input query and the units of the available 
information units to identify the best matches between the input query and the plurality, of available information 
units; 

for the best matches where there are unmatched units in the query and/or the information units, generating 
45 context data in the form of one or more unmatched unit each having a predefined linguistic relationship to one 

of the or each matched unit; and 

outputting desired information units as the best matches with respective said context data. 

20. The method of claim 19, wherein the desired information units are output ordered by said context data. 

50 

21. A carrier medium carrying processor implementable instructions for controlling a processor to carry out the method 
of any one of claims 9 to 16, 1 9 or 20. 

22. A signal carrying processor implementable instructions for controlling a processor to carry out the method of any 
55 one of claims 9 to 1 6, 1 9 or 20. 



13 



EP 1 033 662 A2 



LINGUISTIC 
RELATIONSHIP 
DATA STORAGE 
DEVICE 



CONTEXT 
GENERATING 
ENGINE 



CONTEXT 
GATHERING 
ENGINE 



INTERFACE 
1a 



QUERY 
INPUT 
DEVICE 



^1 



DATA 
OUTPUT 
DEVICE 



/ 4 



1 x- 



MATCHING 
ENGINE 



PARSER 




Fig 1 



14 



EP 1 033 662 A2 




15 



EP 1 033 662 A2 



S1 1 INPUT QUER Y" [ 
S2 j PARSE INPUT QUERY ] 

1 in — ~~ 



SELECT SET OF REFERENCE 
DATA AND PARSE 



S19 



SELECT NEXT 
MATCHED 
WORD t 




16 



EP 1 033 662 A2 




17 



EP 1 033 662 A2 



S20 


INPUT CONTEXT 
DATA FOR PLURALITY 
OF DATA SETS 






r 


S21 


CONCATENATE 
CONTEXTS 




j 


r 


S22 


SELECT HEAD WORD 
USING FIRST PATH 



S25 



SELECT NEXT 
MATCHED WORD AS 
SUB-INDEX 



S23 





NO 



SELECT CONTEXT 
WORD FOR SECOND 
LEVEL 



S27 



S30 



NO 



STORE HIERARCHY OF 

INDEXES AND SUB- 
INDEXES TO WHICH THE 
DATA SETS BELONG 



GROUP DATA SETS 
ACCORDING TO COMMON 
CONTEXT WORDS (OR NO 
CONTEXT) INDEXED BY 
COMMON CONTEXT 
WORDS 




YES- 



S29 

SELECT 
NEXT PATH 
LEVEL 



Fig 5 



18 



EP 1 033 662 A2 



LINGUISTIC 
RELATIONSHIP 
DATA STORAGE 
DEVICE 



CONTEXT 
GENERATING 
ENGINE 



I y 1 



CONTEXT 
GATHERING 
ENGINE 



PARSER 



INTERFACE 



1a 



QUERY 
INPUT 
DEVICE 



1b 



DATA 
OUTPUT 
DEVICE 



/ 4 



MATCHING 
ENGINE 



DATABASE 



Fig 6 



19 



